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Chapter 1 

A Statistical Measure of Complexity 



Abstract In this chapter, a statistical measure of complexity is introduced and some 
of its properties are discussed. Also, some straightforward applications are shown. 
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1 A Statistical Measure of Complexity 



1.1 Shannon Information 

Entropy plays a crucial theoretical role in physics of macroscopic equilibrium sys- 
tems. The probability distribution of accessible states of a constrained system in 
equilibrium can be found by the inference principle of maximum entropy |TJ. The 
macroscopic magnitudes and the laws that relate them can be calculated with this 
probability distribution by standard statistical mechanics techniques. 

The same scheme could be thought for extended systems far from equilibrium, 
but in this case we do have neither a method to find the probability distribution nor 
the knowledge of the relevant magnitudes bringing the information that can predict 
the system's behavior. It is not the case, for instance, with the metric properties of 
low dimensional chaotic systems by means of the Lyapunov exponents, invariant 
measures and fractal dimensions Q. 

Shannon information or entropy H [3] can still be used as a magnitude in a gen- 
eral situation with N accessible states: 

N 

H = -K'Epdogpi (1.1) 

with K a positive real constant and pi the normalized associated probabilities, 
Pi = !■ An isolated system in equilibrium presents equiprobability, p\ = 1 /N 
for all i, among its accessible states and this is the situation of maximal entropy, 

H max = K\ogN. (1.2) 

If the system is out of equilibrium, the entropy H can be expanded around this 
maximum H, mlx : 

NK " ( 1\ 2 NK 
H(p hP2 , ...,Pn)= KlogN - _ £ f w - _ J +■■■= H >»«* - —° +■■■ 

(1-3) 

where the quantity D = Y*i(pi ~ l/^) 2 , that we call disequilibrium, is a kind of 
distance from the actual system configuration to the equilibrium. If the expression 
d X -3b is multiplied by H we obtain: 

H 2 = H ■ H max -^-H-D + K 2 f{N,pi), (1 .4) 

where f{N,pi) is the entropy multiplied by the rest of the Taylor expansion terms, 
which present the form i, (Npi — 1 )'" with m > 2. If we rename C = H ■ D, 

C = cteH- (H^ -H) + Kf(N, Pi ), (1.5) 

with cfe~' = NK/2 and / = 2f/N. The idea of distance for the disequilibrium is 
now clearer if we see that D is just the real distance D ~ (H mux — H) for systems 
in the vicinity of the equiprobability. In an ideal gas we have H ~ H max and D ~ 0, 
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then C ~ 0. Contrarily, in a crystal H ~ and D ~ 1, but also C ~ 0. These two 
systems are considered as classical examples of simple models and are extrema in a 
scale of disorder (H) or disequilibrium (D) but those should present null complexity 
in a hypothetic measure of complexity. This last asymptotic behavior is verified by 
the variable C (Fig. II. Il l and C has been proposed as a such magnitude [4|. We 
formalize this simple idea recalling the recent definition of LMC complexity in the 
next section. 

Let us see another important property @ arising from relation (11.51 l. If we 
take the time derivative of C in a neighborhood of equilibrium by approaching 
C ~ H(H mux — H), then we have 

dC dH 

— ~ —Umax —J- ■ (1.6) 
off flff 

The irreversibility property of implies that ^jj? > 0, the equality occurring only 
for the equipartition, therefore 

f<0. (1.7) 
off 

Hence, in the vicinity of H max , LMC complexity is always decreasing on the evo- 
lution path towards equilibrium, independently of the kind of transition and of the 
system under study. This does not forbid that complexity can increase when the sys- 
tem is very far from equilibrium. In fact this is the case in a general situation as it 
can be seen, for instance, in the gas system presented in Ref. |6). 



1.2 A Statistical Complexity Measure 

On the most basic grounds, an object, a procedure, or system is said to be "com- 
plex" when it does not match patterns regarded as simple. This sounds rather like 
an oxymoron but common knowledge tells us what is simple and complex: simpli- 
fied systems or idealizations are always a starting point to solve scientific problems. 
The notion of "complexity" in physics J71I11 starts by considering the perfect crystal 
and the isolated ideal gas as examples of simple models and therefore as systems 
with zero "complexity". Let us briefly recall their main characteristics with "order", 
"information" and "equilibrium". 

A perfect crystal is completely ordered and the atoms are arranged following 
stringent rules of symmetry. The probability distribution for the states accessible to 
the perfect crystal is centered around a prevailing state of perfect symmetry. A small 
piece of "information" is enough to describe the perfect crystal: the distances and the 
symmetries that define the elementary cell. The "information" stored in this system 
can be considered minimal. On the other hand, the isolated ideal gas is completely 
disordered. The system can be found in any of its accessible states with the same 
probability. All of them contribute in equal measure to the "information" stored in 
the ideal gas. It has therefore a maximum "information". These two simple systems 
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are extrema in the scale of "order" and "information". It follows that the definition 
of "complexity" must not be made in terms of just "order" or "information". 

It might seem reasonable to propose a measure of "complexity" by adopting 
some kind of distance from the equiprobable distribution of the accessible states of 
the system (4). Defined in this way, "disequilibrium" would give an idea of the prob- 
abilistic hierarchy of the system. "Disequilibrium" would be different from zero if 
there are privileged, or more probable, states among those accessible. But this would 
not work. Going back to the two examples we began with, it is readily seen that a 
perfect crystal is far from an equidistribution among the accessible states because 
one of them is totally prevailing, and so "disequilibrium" would be maximum. For 
the ideal gas, "disequilibrium" would be zero by construction. Therefore such a dis- 
tance or "disequilibrium" (a measure of a probabilistic hierarchy) cannot be directly 
associated with "complexity". 

In Figure fTTI we sketch an intuitive qualitative behavior for "information" H and 
"disequilibrium" D for systems ranging from the perfect crystal to the ideal gas. As 
indicated in the former section, this graph suggests that the product of these two 
quantities could be used as a measure of "complexity": C = H D. The function C 
has indeed the features and asymptotic properties that one would expect intuitively: 
it vanishes for the perfect crystal and for the isolated ideal gas, and it is different 
from zero for the rest of the systems of particles. We will follow these guidelines to 
establish a quantitative measure of "complexity". 

Before attempting any further progress, however, we must recall that "complex- 
ity" cannot be measured univocally, because it depends on the nature of the descrip- 
tion (which always involves a reductionist process) and on the scale of observation. 
Let us take an example to illustrate this point. A computer chip can look very differ- 
ent at different scales. It is an entangled array of electronic elements at microscopic 
scale but only an ordered set of pins attached to a black box at a macroscopic scale. 

We shall now discuss a measure of "complexity" based on the statistical descrip- 
tion of systems. Let us assume that the system has N accessible states {x\,X2, 
when observed at a given scale. We will call this an A-system. Our understanding of 
the behavior of this system determines the corresponding probabilities {pi,P2, --^Pn} 
(with the condition Y,?=i Pi = 1) of each state (pi > for all i). Then the knowledge 
of the underlying physical laws at this scale is incorporated into a probability dis- 
tribution for the accessible states. It is possible to find a quantity measuring the 
amount of "information". As presented in the former section, under to the most 
elementary conditions of consistency, Shannon [Q determined the unique func- 
tion H(p\,p2, ■■■,Pn) given by expression ( II. Il l, that accounts for the "information" 
stored in a system, where K is a positive constant. The quantity H is called infor- 
mation. The redefinition of information H as some type of monotone function of 
the Shannon entropy can be also useful in many contexts. In the case of a crystal, a 
state x c would be the most probable p c ~ 1, and all others xi would be very improb- 
able, pi ~ i 7^ c. Then H c ~ 0. On the other side, equiprobability characterizes an 
isolated ideal gas, ~ 1 /N so H g ~ KlogN, i.e., the maximum of information for 
a N-system. (Notice that if one assumes equiprobability and K = K = Boltzmann 
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Fig. 1.1 Sketch of the intuitive notion of the magnitudes of "information" (H) and "disequilibrium" 
(D) for the physical systems and the behavior intuitively required for the magnitude "complexity". 
The quantity C = H ■ D is proposed to measure such a magnitude. 



constant, H is identified with the thermodinamic entropy, S = KlogN). Any other 
N-system will have an amount of information between those two extrema. 

Let us propose a definition of disequilibrium D in a A^-system (9|. The intuitive 
notion suggests that some kind of distance from an equiprobable distribution should 
be adopted. Two requirements are imposed on the magnitude of D: D > in order to 
have a positive measure of "complexity" and D — on the limit of equiprobability. 
The straightforward solution is to add the quadratic distances of each state to the 
equiprobability as follows: 

N / , \ 2 

D • (L8) 

According to this definition, a crystal has maximum disequilibrium (for the dom- 
inant state, p c ~ 1, and D c —> 1 for N — >• °°) while the disequilibrium for an ideal 
gas vanishes (D g ~ 0) by construction. For any other system D will have a value 
between these two extrema. 
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We now introduce the definition of complexity C of a A^-system J4][T0]. This is 
simply the interplay between the information stored in the system and its disequi- 
librium: 



This definition fits the intuitive arguments. For a crystal, disequilibrium is large but 
the information stored is vanishingly small, so C ~ 0. On the other hand, H is large 
for an ideal gas, but D is small, so C ~ as well. Any other system will have an 
intermediate behavior and therefore C > 0. 

As was intuitively suggested, the definition of complexity dl.9t also depends on 
the scale. At each scale of observation a new set of accessible states appears with its 
corresponding probability distribution so that complexity changes. Physical laws at 
each level of observation allow us to infer the probability distribution of the new set 
of accessible states, and therefore different values for H, D and C will be obtained. 
The straightforward passage to the case of a continuum number of states, x, can be 
easily inferred. Thus we must treat with probability distributions with a continuum 
support, p(x), and normalization condition fjj^ p{x)dx = 1. Disequilibrium has the 
limit D = f_™ p 2 (x)dx and the complexity could be defined by: 



Other possibilities for the continuous extension of C are also possible. For instance, 
a successful attempt of extending the LMC complexity for continuous systems has 
been performed in Ref. ifTTI . When the number of states available for a system is a 
continuum then the natural representation is a continuous distribution. In this case, 
the entropy can become negative. The positivity of C for every distribution is re- 
covered by taking the exponential of H fl2l . If we defineC = H D = e H D as an 
extension of C to the continuous case interesting properties characterizing the indi- 
cator C appear. Namely, its invariance under translations, rescaling transformations 
and replication convert C in a good candidate to be considered as an indicator bring- 
ing essential information about the statistical properties of a continuous system. 

Direct simulations of the definition give the values of C for general A^-systems. 
The set of all the possible distributions {pi,P2,---,Pn} where an A^-system could be 
found is sampled. For the sake of simplicity H is normalized to the interval [0, 1]. 
Thus H = Yli=\ pTog pi/\ogN. For each distribution {/?,} the normalized informa- 
tion H({pi}), and the disequilibrium £)({/?,}) feq. ll.8b are calculated. In each case 
the normalized complexity C — H D is obtained and the pair (H,C) stored. These 
two magnitudes are plotted on a diagram (H,C(H)) in order to verify the qualitative 
behavior predicted in Figure 1X7X1 For N = 2 an analytical expression for the curve 
C(H) is obtained. If the probability of one state is p\ = x, that of the second one is 
simply p2 = 1 — x. Complexity vanishes for the two simplest 2-systems: the crystal 
(H = 0; p\ = 1, p 2 = 0) and the ideal gas (H = 1; pi = 1 /2, p 2 = 1 /2). Let us 
notice that this curve is the simplest one that fulfills all the conditions discussed in 





(1.10) 
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0.2 0.4 0.6 0.8 1 

H 

Fig. 1.2 In general, dependence of complexity (C) on normalized information (H) is not univocal: 
many distributions {p,} can present the same value of H but different C. This is shown in the case 
JV = 3. 

the introduction. The largest complexity is reached for H ~ 1/2 and its value is: 
C(x ~ 0.1 1) ~ 0.151. For N > 2 the relationship between H and C is not univocal 
anymore. Many different distributions {pi} store the same information H but have 
different complexity C. Figure [L2l displays such a behavior for N = 3. If we take 
the maximum complexity C max (H) associated with each H a curve similar to the 
one for a 2-system is recovered. Every 3-system will have a complexity below this 
line and upper the line of C m \„ (H) and also upper the minimum envelope complex- 
ity Cminenv These lines will be analytically found in a next section. In Figure [T31 
curves C nmx (H) for the cases N = 3, . . . , 10 are also shown. Let us observe the shift 
of the complexity-curve peak to smaller values of entropy for rising N. This fact 
agrees with the intuition telling us that the biggest complexity (number of possi- 
bilities of 'complexification') be reached for lesser entropies for the systems with 
bigger number of states. 

Let us return to the point at which we started this discussion. Any notion of 
complexity in physics Q [8] should only be made on the basis of a well defined or 
operational magnitude JU [TOl . But two additional requirements are needed in order 
to obtain a good definition of complexity in physics: (1) the new magnitude must be 
measurable in many different physical systems and (2) a comparative relationship 
and a physical interpretation between any two measurements should be possible. 
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Many different definitions of complexity have been proposed to date, mainly 
in the realm of physical and computational sciences. Among these, several can be 
cited: algorithmic complexity (Kolmogorov-Chaitin) |[T3l[T4l . the Lempel-Ziv com- 
plexity |fl3), the logical depth of Bennett |[T6l . the effective measure complexity of 
Grassberger ifTTl . the complexity of a system based in its diversity ifTHl . the thermo- 
dynamical depth lfl9l . the e-machine complexity j20l , the physical complexity of 
genomes ||2T1 . complexities of formal grammars, etc. The definition of complexity 
( 11.91 ) proposed in this section offers a new point of view, based on a statistical de- 
scription of systems at a given scale. In this scheme, the knowledge of the physical 
laws governing the dynamic evolution in that scale is used to find its accessible states 
and its probability distribution. This process would immediately indicate the value 
of complexity. In essence this is nothing but an interplay between the information 
stored by the system and the distance from equipartition (measure of a probabilistic 
hierarchy between the observed parts) of the probability distribution of its accessi- 
ble states. Besides giving the main features of a "intuitive" notion of complexity, we 
will show in this chapter that we can go one step further and that it is possible to 
compute this quantity in relevant physical situations [6, 22, 231 ■ The most important 
point is that the new definition successfully enables us to discern situations regarded 
as complex. 
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1.3 LMC Complexity: Extremal Distributions 



Now we proceed to calculate the distributions which maximize and minimize the 
LMC complexity and its asymptotic behavior |6 |. 

Let us assume that the system can be in one of its N possible accessible states, ;. 
The probability of the system being in state i will be given by the discrete distribu- 
tion function, /; > 0, with the normalization condition / = Yd=\ fi = !• The system 
is defined such that, if isolated, it will reach equilibrium, with all the states having 
equal probability, / e = i,. Since we are supposing that H is normalized, < H < 1, 
and <D < (N —1)/N, then complexity, C, is also normalized, < C < I. 

When an isolated system evolves with time, the complexity cannot have any pos- 
sible value in a C versus H map as it can be seen in Fig. II. 21 but it must stay within 
certain bounds, C max and C m ; n . These are the maximum and minimum values of C 
for a given H. Since C = DH, finding the extrema of C for constant H is equivalent 
to finding the extrema of D. 

There are two restrictions on D: the normalization, /, and the fixed value of the 
entropy, H. To find these extrema undetermined Lagrange multipliers are used. Dif- 
ferentiating expressions of D, I and H, we obtain 

|^=2(/ j -/ e ), (1.11) 



1, (1-12) 



dfj 
dl_ 

dfj 
dH 

drr-^ {lnfi+1) - (L13) 

Defining X\ and X2 as the Lagrange multipliers, we get: 

2 (/; - /e ) + Ai + A 2 (In fj + \)/\nN = 0. (1.14) 

Two new parameters, a and /3, which are a linear combinations of the Lagrange 
multipliers are defined: 

/; + aln/) + j3 = 0, (1.15) 

where the solutions of this equation, fj, are the values that minimize or maximize 
the disequilibrium. 

In the maximum complexity case there are two solutions, fj, to Eq. ( 11.15b which 
are shown in Table ll.ll One of these solutions, / max , is given by 



1 

H = 

lnN 



/max In /max ~t~ (1 /max) 111 



max 



N-l 



(1.16) 



and the other solution by ( 1 — / max ) / (N — 1 ) . The maximum disequilibrium, D n 
for a fixed H is 
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£>max = (/max ~ ft ? + (N - 1 ) ( 1 ~ - / e ) , (1.17) 

and thus, the maximum complexity, which depends only on H, is 

Ctmx(H) ~ D max ■ H . (1.18) 

The behavior of the maximum value of complexity versus InAf was computed in 
Ref. fl24l . 

Table 1.1 Probability values, /,-, that give a maximum of disequilibrium, f max , for a given H. 



Number of states 
with fj 


fj 


Range of fj 


1 


./max 




N— 1 


1 — /max 
N-\ 


0...1 



Table 1.2 Probability values, /y, that give a minimum of disequilibrium, Z) m j n , for a given H. 



Number of states 


fj 


Range of /, 


with fj 


n 








1 


fmm 


- 7^ 


N-n- 1 


' — ./min 


1 1 


iV-n-1 


N-n ■■■ AT-n-1 



n can have the values 0,1, . . . N — 2. 



Equivalently, the values, fj, that give a minimum complexity are shown in Table 
PI One of the solutions, f m i n , is given by 



1 

H = 

lnJV 



/min In /min + ( 1 - /min ) In 



1 /min 

N-n- l 



(1.19) 



where n is the number of states with fj = and takes a value in the range n 
0,1, ... ,N — 2. The resulting minimum disequilibrium, D m ; n , for a given // is, 



Omin = (/min ~ /e) 2 + ~ * ~ 1) ^ _ ^ ~ /e J + »/e • ( 1 - 2 V 

Note that in this case fj = is an additional hidden solution that stems from the 
positive restriction in the / values. To obtain these solutions explicitly we can define 
Xi such that / = x, 2 . These x, values do not have the restriction of positivity imposed 
to f and can take a positive or negative value. If we repeat the Lagrange multiplier 
method with these new variables a new solution arises: xj = 0, or equivalently, fj = 
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0. The resulting minimum complexity, which again only depends on H, is 

C min (H)=D min -H. (1.21) 

As an example, the maximum and minimum of complexity, C max and C m i n , are plot- 
ted as a function of the entropy, H, in Fig. 1 1.41 for N = 4. Also, in this figure, it is 
shown the minimum envelope complexity, C m j nen v = ^minenv • H, where D m j nenv is 
defined below. In Fig. 11.51 the maximum and minimum disequilibrium, D max and 
^mhi! versus H are also shown. 



N = 4 




H 

Fig. 1.4 Maximum, minimum, and minimum envelope complexity, C ma x, Cmin. and C m i ne nv respec- 
tively, as a function of the entropy, H, for a system with N = 4 accessible states. 



As shown in Fig. ll.5l the minimum disequilibrium function is piecewise defined, 
having several points where its derivative is discontinuous. Each of these function 
pieces corresponds to a different value of n (Table II. 21 ). In some circumstances it 
might be helpful to work with the "envelope" of the minimum disequilibrium func- 
tion. The function, Aninenv, that traverses all the discontinuous derivative points in 
the Z) m i n versus H plot is 

r> — —H\nN _ /i 

^minenv — " ^ i ^l.ZZJ 

and is also shown in Figure [T31 




When N tends toward infinity the probability, f max , of the dominant state has a 
linear dependence with the entropy, 

lim/ max = l-H, (1.23) 
and thus the maximum disequilibrium scales as limTv^oo fmax = 

(l-//) 2 .The max- 
imum complexity tends to 

limC max =//-(l-//) 2 . (1.24) 

AT-^oo 

The limit of the minimum disequilibrium and complexity vanishes, lim;v^oo £> m inenv ~ 
0, and thus 

limC min = 0. (1.25) 

In general, in the limit N — > °°, the complexity is not a trivial function of the entropy, 
in the sense that for a given H there exists a range of complexities between and 
C max , given by Eqs. fll.25t and dl.24t , respectively. 

In particular, in this asymptotic limit, the maximum of C max is found when 
H = 1/3, or equivalently / max = 2/3, which gives a maximum of the maximum 
complexity of C max =4/27. This value was numerically calculated in Ref. 11241 . 
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Generalized entropies were introduced by Renyi [25) in the form of 

' N \ 
I 



/c ' = r^ log (£^)' (L26) 



where q is an index running over all the integer values. By differentiating l q with 
respect to q a negative quantity is obtained independently of q, then I q monotonously 
decreases when q increases. 

The Renyi entropies are an extension of the Shannon information H. In fact, H 
is obtained in the limit q — > 1 : 

N 

H = h = ]iml g =-Ypilog Pi , (1.27) 

9-H , = 1 

where the constant K of Eq. ( 11. j} is considered to be the unity. The disequilibrium 
D is also related with I% = — log ) ■ We have that 



then the LMC complexity is 



1 



The behavior of C in the neighborhood of H max takes the form 

C~^(l g 2 N-hh), 



(1.30) 



The obvious generalization of the Renyi entropies for a normalized continuous dis- 
tribution p(x) is 

I q =-^\ogJ[p(x)Y'dx. (1.31) 

Hence, 

H = h = — J p(x)lagp(x)dx, (1.32) 

D = e-' 2 = J [p{x)] 2 dx. (1.33) 

The dependence of C = e H ■ D with I\ and I2 yields 

logC = {h-h). (1.34) 
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This indicates that a family of different indicators could derive from the differences 
established among Renyi entropies with different ^-indices (5|- Let us remark at 
this point the coincidence of the indicator log C with the quantity S str introduced by 
Varga and Pipek as a meaningful parameter to characterize the shape of a distribu- 
tion. They apply this formalism to the Husimi representation, i.e., to the projection 
of wave functions onto the coherent state basis l26l . A further generalization of the 
LMC complexity measure as function of the Renyi entropies has been introduced in 
Ref. Il27l. 

The invariance of C under rescaling transformations implies that this magnitude 
is conserved in many different processes. For instance, the initial Gaussian-like dis- 
tribution will continue to be Gaussian in a classical diffusion process. Then C is 
constant in time: ^ = 0, and we have: 

The equal losing rate of I\ and I2, i.e., the synchronization of both quantities, is the 
cost to be paid in order to maintain the shape of the distribution associated to the 
system and, hence, all its statistical properties will remain unchanged during its time 
evolution. 



1.5 Some Applications 

If by complexity it is to be understood that property present in all systems attached 
under the epigraph of 'complex systems', this property should be reasonably quan- 
tified by the measures proposed in the different branches of knowledge. In our case, 
the main advantage of LMC complexity is its generality and the fact that it is opera- 
tionally simple and do not require a big amount of calculations 0281 . This advantage 
has been worked out in different examples, such as the study of the time evolution 
of C for a simplified model of an isolated gas, the "tetrahedral gas" (6j or also in 
the case of a more realistic gas of particles ||291|30| , the slight modification of C as 
an effective method by which the complexity in hydrological systems can be iden- 
tified OTl . the attempt of generalize C in a family of simple complexity measures 
Il32ll33ll34l . some statistical features of the behavior of C for DNA sequences l35l 
or earthquake magnitude time series ll36l . some wavelet-based informational tools 
used to analyze the brain electrical activity in epilectic episodes in the plane of co- 
ordinates (H,C) J37l, a method to discern complexity in two-dimensional patterns 
ll38l or some calculations done on quantum systems |39l l40l |4T1 l42l l43l . As an 
example, we show in the next subsections some straightforward calculation of the 
LMC complexity l44l . 



1.5 Some Applications 

1.5.1 Canonical ensemble 
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Each physical situation is closely related to a specific distribution of microscopic 
states. Thus, an isolated system presents equipartition, by hypothesis: the mi- 
crostates compatible with a macroscopic situation are equiprobable 11451 . The system 
is said to be in equilibrium. For a system surrounded by a heat reservoir the proba- 
bility of the microstates associated to the thermal equilibrium follow the Boltzmann 
distribution. Let us try to analyze the behavior of C in an ideal gas in thermal equilib- 
rium. In this case the probability /?, of each accesible state is given by the Boltzmann 
distribution: 

P -m 

(1.36) 



r ' Qn ' 

Qn = J ^^^-^ d-37) 

where Qn is the partition function of the canonical ensemble, /? = 1/kT with K 
the Boltzmann constant and T the temperature, V the volume, N the number of 
particles, E(p,q) the hamiltonian of the system, h is the Planck constant and A(V, T) 
the Helmholtz potential. 

Calculation of H and D gives us: 

H(V,T) = (l + T-^)(KlogQ N )=S(V,T), (1.38) 
D{VJ) =e W[Mvj)-A(vj/2)]^ (139) 

Note that Shannon information H coincides with the thermodynamic entropy S 
when K is identified with K. If a system verifies the relation U = C V T (U the in- 
ternal energy, C v the specific heat) the complexity takes the form: 

C(V, T) - cte(V) ■ S(V, T)e- s{VJ)/K (1 .40) 

that matches the intuitive function proposed in Figure [TTI 



1.5.2 Gaussian and exponential distributions 



Gaussian distribution: Suppose a continuum of states represented by the x variable 
whose probability density p(x) is given by the normal distribution of variance a: 

pW ^ exp (-^)^ (L4I) 

After calculating H and D, the expression for C is the following: 
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C g =H.D = _^Q +bg(ff ^E)j. (1.42) 



If we impose the additional condition H > 0, then a > <7, m „ = (2ne)~ l l 2 . The 
highest complexity is reached for a determined width: a = \J (e/2n). 

Exponencial distribution: Consider an exponencial distribution of variance y: 

M = \'f* 7X> <o 

[0 x < 0. 

The same calculation gives us: 

Q = |-(l+logy), (1.44) 

with the condition H > imposing y > y m ,„ = e . The highest complexity corre- 
sponds in this case to y = 1 . 

Remark that for the same width than a Gaussian distribution (c = y), the expo- 
nential distribution presents a higher complexity (C e / C g ~ 1 .4). 



1.5.3 Complexity in a two-level laser model 

One step further, combining the results obtained in the former sections, is now done. 
We calculate LMC complexity for an unrealistic and simplified model of laser l46l . 

Let us suppose a laser of two levels of energy: £1=0 and Ei = £, with N\ atoms 
in the first level and N2 atoms in the second level, and the condition N\ +N2 = 
N (the total number of atoms). Our aim is to sketch the statistics of this model 
and to introduce the results of photon counting [47 1 that produces an asymmetric 
behavior of C as function of the population inversion rj = N2 /N. In the range rj £ 
(0, 1 /2) spontaneous and stimulated emission can take place, but only in the range 
77 € (1/2,1) the condition to have lasing action is reached, because the population 
must be, at least, inverted, 77 > 1/2. 

The entropy S of this system vanishes when Ni or is zero. Moreover, S must be 
homegenous of first order in the extensive variable l48ll . For the sake of simplicity 
we approach S by the first term in the Taylor expansion: 

5- K-j^ = £#17(1-17). (1.45) 
The internal energy is U = A^£ = £Nr] and the statistical temperature is: 
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Note that for 77 > 1/2 the temperature is negative as corresponds to the stimulated 
emission regime dominating the actual laser action. 

We are now interested in introducing qualitatively the results of laser photon 
counting in the calculation of LMC complexity. It was reported in B71 that the 
photo-electron distribution of laser field appears to be poissonian. In the continuous 
limit the Poisson distribution is approached by the normal distribution J49|. The 
width a of this energy distribution in the canonical ensemble is proportional to the 
statistical temperature of the system. Thus, for a switched on laser in the regime 
77 € [1 /2, 1], the width of the gaussian energy distribution can be fitted by choosing 
U ^ j ^ 1/ (2 77 — 1) (recall that T < in this case). The range of variation of a 
is [<t«,, Omin] = [°°, (2ne)~ x l 2 \. Then we obtain: 

(2ne)- l l 2 

g~ \ ; ■ d-47) 
2T7 - 1 

By replacing this expression in Eq. ( 11.421 ). and rescaling by a factor proportional 
to entropy, S ~ kN, (in order to give to it the correct order of magnitude), LMC 
complexity for a population inversion in the range 77 G [1 /2, 1] is reobtained: 

Closer KN- (1 -277)l0g(277 - 1). (1.48) 

We can consider at this level of discussion Ci aser = for 77 < 1/2. Regarding the 
behavior of this function, it is worth noticing the value 772 ~ 0.68 where the laser 
presents the highest complexity. By following theses ideas, if the width, a, of the 
experimental photo-electron distribution of laser field is measured, the population 
inversion parameter, 77, would be given by Eq. ( 11.471 ). In a next step, the LMC 
complexity of the laser system would be obtained by Eq. ( 11.48b . 

It is necessary to remark that a model helps us to approach the reality and pro- 
vides invaluable guidance in the goal of a finer understanding of a physical phe- 
nomenon. From this point of view the present calculation evidently only tries to 
enlighten the problem of calculating the LMC complexity of a physical system via 
an unrealistic but simplified model. 



1.6 Conclusions 



A definition of complexity (LMC complexity) based on a probabilistic description 
of physical systems has been explained. This definition contains basically an inter- 
play between the information contained in the system and the distance to equiparti- 
tion of the probability distribution representing the system. Besides giving the main 
features of an intuitive notion of complexity, we show that it allows to successfully 
discern situations considered as complex in systems of a very general interest. Also, 
its relationship with the Shannon information and the generalized Renyi entropies 
has been shown to be explicit. Moreover it has been possible to establish the de- 
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crease of this magnitude when a general system evolves from a near-equilibrium 
situation to the equipartition. 

From a practical point of view, we are convinced that this statistical complexity 
measure provides a useful way of thinking [50| and it can help in the future to gain 
more insight on the physical grounds of models with potential biological interest. 
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